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ABSTRACT 


The rurdue Motion end Time Study Laboratory and some 
ef the plants in American industry are using the muliti-image 
loop to help the pece-rating step of the procedure used to 
determine time standards. The loop has been found helpful 
in improving eccuracy end consistency, and it seems tc be 
one of the best answers so far arrived at in this eontro- 
versial field. 

One of the objections presented as s weakness of the 
loop is that it shows only essentially an srm movement and 
raters have difficulty in comparing the peco as shown by 
this movement with other types of movement using different 
members of the body. 

The author of this thesis endeavored to investigate 
the subject mentioned in the previous persgreph. Lifferent 
jobs involving different body mombers were filmed at differ- 
ent paces and raters were asked to pace-rate them; first 
unaided, and secondly sided by the loop. 

The results were compared and subjected to statistical 
analysis from the view point of both accuracy end con- 
sistoncy. 

Results 

1. From the point of view of accurecy: 

& The accuracy in rating wes significentliy ime 
proved, et leest in some paces, in ell jobs except the one 


consisting of walking. In this job, the acouracy in rating 
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was Significently poorer with the loop than withcut it. 

b. In no case, except in the job conslsting 
of walking, wes rating significantly poorer with the loap 
then without it. 

&. From the viewpoint of consistenvy: 

a. The jobs consisting of full erm end forearm 
movement were the only ones that in eli cases were rated 
Significantly better when using the loop. 

db. The jobs consisting of fingers ant trunk 
mevements were rated significantly poorer in the aided 
condition. 

c. The jobs consisting of walking and wrist 
movement did not show conclugive results. 

Conolusions 

It can be said with e considersble emount of confidence, 
from the results elready stated, that, except in the case of 
the walking job, the loop helped the raters considerably in 
improving their accuracy, even when it did not improve their 
consistency. This seems to indicate that the loop is a 
powerful means to impose a uniform concept of standard pace 
upon a group of individuals, except in the case of walking 
and, probably, movements of the whole body. Also, with due 
consideration given to the eaception elready pointed out, 
use of the loop seems to decrease the known tendency to rete 


low-paced performence high, and highe-paced performences low. 


31 LUGI le WOOT Qood ate G26 swre~y Lidunetilagie aan 
walstiagos dol ais ai dywous come wa a od 
yen wild SUN mewoed Vitae ritigity WELIEY Bie “Geitine 10 
eto ie @! gull Oe \ Getto oA Quel uw wants 
ee ale) et a en 
i eee ee a, 
BRUNE 9te Sseno Ar HE Cand Heme ELC usr Pew Vodeeven 
ee AAT ques Ode Poor Yea dD iaate 
AuuTs ts etapAL) Zu Bditatunoe odo, GP 
hh a ok | TUE agla Loner wpow e2nemwes 


— foe bee me 4h re |i Ged 
Welw a piiiiow to piidstenes ade, ash +b 
ee eee woe Fon Bk fume 

atojaulenc®. ©) © (© ee 


_Maeh wes lo dave eideienteue « uliw Slee oo mae JL 
Se sume 054 ah Sqeomm Jeet , misty Yase1 Le 2S lunet Oa Mott 
Ob Uduaetéance eretet ead beylew yoot aus .oul gulaiew ace 
Meet efesai son We 4) Cute Come , (onped test enivorual 
® #2 (out O44 dene event Dal w exees aff? .taeweeLeauw 
A Atebasde Wo éye0aes mielian # feeqal oF enum iv brewed 
Wiitiew 14 eee 13 a) dqvonp ,odaubivibal Io quety & aogy 
OOD Ofi4 .vele .ghed Slow ec4 to syoeeerce (Acadume , fee 
. io Selalog (eerie acidupone O4% OS Bote Galvetestenee 
eJ*S OF Teneines Gea O02 euewtoeh Of axes GOO’ a0s 16 om 
ooh OPORTO L0bee—elS bbe ,deld epaamtultey 00004-wed 





INVESTIGATION oF The sFYEOCT UF 
THL AMVUNT uF Buy Uso 
ON THE ACCURACY AND CURSISTERCY UF FACH-RATLNG 
(MULT I-LIMAGE wovh) 


INTRODUCTION 

Time study hes been, sinee its introduction in the 
field of bngineering, a fascinsting and controversial sub- 
ject. SGesides other uses, Time study is a greet stride 
towards the highly appealing objective of having all the 
employees in an orgenizetion paid fairly and equitably. 

However, even @ saell emount of thought cun imnedia- 
tely show the enormous difficulties in setting these 
steanderds. 4S cone gves deeper into the sudject, the diffi- 
culties seom to increase both in degree and in amount. 

without doubt, tho most difficult step in setting 
time stenderds is the appraisal of the effert that the 
operator is expending in performing the job being stu- 


died. Svme lesders in the subject, \+? among them vr. 








1. &resgrave, k., "Dynamics of Time Study", New York, i. 7., 
ite Graw-Hill Book Cyv., 1945. ; 








Me. & Hundel (2) and his associates of the Purdue sotion 


and Time Study Laboratory, have tried to decreese the diffi- 
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2. mundel, KH. s., “Motion and Time study, srinelples ond 
xraotice", Kew York, :rentice-iiesll, 1950. 








culty of this step by separating Job difficulty from the 
rating. The rater, eccording to their procedure, is con- 
cerned vith pace alone, and rates only this element of the 
performanee; in other words, he pace-retes the performence,. 
All other factors of the job ere teken care of, posteriorly, 


by means of secondary adjustments, (9) 








Sr I ee 


5S. Mundel, M. L., “Motion and Time otudy, irinciples and 
Freetice", New York, trontice-lall, 1950. 





As a further way cf improving rating procedure, ur. 
Mundel end his associates developed ea motion picture film 
thst shows twelve images simultaneously; in each image, the 
same Simple job is performed, the pace varying from image 
to image, ranging from 79 to 156 percent of normal pece. 
The job being performed involves essentielly ean arm muvee 
ment. in order to facilitete continuous projection of the 
film for relatively long periods of time, the film used is 
in the form of a loop, with its ends cemented together. It 
is known as the multi-image loop and, in this thesis, will 
be called simply the loop. 


it Bhas been shown by « study of the works of Keim, '4) 
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4. heim, d. Aw, “An Evaluation of Time ctudy Keating", Mase 
ter's Thesis, vurdue University, 1950. 

S. sehrer, M. &., "An Evaluation of Two Time Study Hating 
Aids", Master's Thesis, yurdcue University, 1947, 

6. hla, A. d., "An Analysis of Current Fractice Uneided 
Time study waht , haster's Thesis, :urdue University, 
1950. 





tained from unsided experienced time study men, in 45% of 
the time the error in rating was greater then i10p. These 
results show how techniques to improve securacy in rating, 
es the loop just described, ere needed. 


The loop hes been evaluated egainst raw rating\7) end 
other rating techniques and has been found helpful in inm- 


proving in general both accuracy and oonsisteney. (8) Howe 





7. For detailed description of rew rating see: ala, A. d., 
"An anelysis cf Ourrent Yractice Unaided Time Study nating”, 
Master's Thesis, rurdue University, 1950. 

& RKadkins, A. #?., “Somparison anué Lvaluation of Taree Time 
wtudy Rating Techniques", Masters Thesis, *urdue University, 
dune, 1950. dstéundel, i. Bs, “Notion end Time Study, srinciples 
and wractice", itiew York, #rentico-Haell, 1950. “Report of Sth. 
Annual siotion and Tine Study work Session, 1950", surdue 
University. 








ever, the investigations to-date definitly show that there 
is still a very large field for improvement, sinee the re- 
suits of the use of the loop have beon far from perfect. 
Lts use still does not eliminate the human judgement exisat- 


ing in pacé-rating, which is inécsad the heart of tne diffi- 





Pa Vis Se POT me et he eee ae | 


per pe 
PEOAT WHOS GWE VeSheTy dwn gatsys as sexx oid emild 


~ +458 —™ * ae 






















: . 


oe eminent oar 












; 











= - a 6 ’ ; 


ses Bedi eum TACANALED eaebh-er ecydbeegitowval of) yore 
OG £68 eked ddemovynenh sot biel? wpted ques “Lise OF 

OST e woTl Get aeed owed geod ay Yo ee ats to acl 
Weise Shum pee) ates be) eterlatis ace wood i Lise emu ag) 
ofTrhs sae to felda eds FEESAl of SGldw ,dAlvedt—etey 4 onl 





culty of the step. 

Une of the objections that the users of the loop have 
offered is that it becomes difficult to corpare the pace of 
the job being studied with those shown in the loop when the 
body mamber being used end the type of movement in the job 


aiffer marxedly from those of the loop .'9) The difficulty 





9. Tseng, A. T., “An Evaluation of the sffectiveness of 
Ketention of the Vencept of a SGtendard Lmbodied in a Wulti-g 
Imeze Fece-Kating aided , Unpublished Master's Thesis, 
vurdue University. 





is easy to understand when one remembers that we ere trying 
to evaluate sccelerstions of body mexbers end that the ime 
pression of pace ceused by different body members making 
different types of movements may vary, even if the ace 


celeration in reality is the same. 
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kURYOS 
The purpose of this thesis is to investigate the 
effect of the umount of the body used on the consistency 
end aceursey of pace-reting, when the rater is using the 
multi-imege loop es « rating aid. In other words, this 
thesis will investigate how ratings mede with the help 
of the loop vary as the body members involved in the job 


being rated also vary. 
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PRUCRUUE. 


Six laboratoryetype jobs were chosen by tke author 


end filmed. The jobs were kept very simpie anc very 


definitely designed so es to have successively larger 


groups of body members involved in activity. Three 


paces of each job were filmed, the pece being controlled 


by a metronome. The foliowing types of joba were filmed: 


dob l. 


JOD &. 


Jobd 3. 


Job 4. 


Joo 5. 


The operstor turns a nut on a 3/4" bolt, 
using fingers oniy. 

The operator turns 6 16 mm. movie wheel, 
supported on a rewinder, using meinaly 
wrist motion. 

The operetor touches successively two 
piste switches, about twenty inches 

apart, on a horizontel pian, useing only 
fore-arm motion. 

The operator pleces metallic balis into 

cs hole, one by one, after grasping them 

at a bin about seventeen inches from the 
hole; he uses here full arm motion. 

The operator picks up light small boxes 
from the floor one by one, and pleces then 
on the top of an average-size teble thirty 
inches in height; the trunk is here the 
sost important body member «s far as the 


control of the pace goes. The operator 
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wes instructed to keep his arms rigid 
with respect to his trunk. 
Job 6. The operetor walks in fromt of the camera, 
normel to the axis of the lens of the 
Camera. 

Two groups of reters were used. Une group wes cote 
posed of students of the blementary Motion and Time wotudy 
Classes and will be called Group A, for convenience; the 
other group wes composed of Jteff sembers of the Industriel 
ingineering Department and students of the Advanced Motion 
ena Time Study classes with some experience in rating with 
the loop and will be ealled Greup 3B. The first group have 
hed no experience at all in rating. 

The several sequences were filmed at the rate of 1,000 
frames per nilnute and projected et the seme speed. The films 
were cemented in sequence, in the following order. The 


paces were randomized; 


Films order Job end pece 
aL dod 1, slow. 
Ee Job 4, mediur 
Se Job 6, fast 
4. Job 2, fuet 
S. Jobo 3, fest 
&. Job 5, medium 
F. Job 1, fast 
8. dob 4, fast 
Q. dob 6, medium 

iO. gob &, medium 
ii. dob 3, medium 
iz. Job 5, slow 
iS. dob 1, medium 
14. Job 4, slow 
iS. Job 6, slow 
ié. Job 2, slow 


Films order Job and pece 
17. Job 3, slow 
15. Joo 53, fest 


The words slow, medium end fast are used in this thesis 
only in a comparative sense within the suze job. 

The seme set of instructions were written on a black- 
board each time the film wes going to be shown to raters. 
The set of instructions consisted of the definition cf pece, 
6 Gaution to pay no attention to the Job difficulty; and, 
when the loup was used, ea statement asking reters to try 
to use the loop te its greatest possibie advantage was edded. 

The raters first reted the sequence of jobs without the 
doop, based on their own individual cuncept of normal pace 
as defined by vr. Mundel. All raters were guite feallisr 
with this definition. 

After a period of about two weeks, the sequence wes 
again shown to the raters and the rating done with the help 
ef the loop, projected side by side with the film. The 
correct pace of each impge was shown elso on s convenlent 
place where it could be seen during rating. vuring both 
rating periods, the control of the speed of projection was 
made continuously with the eid of a strobotac, assuring the 
speed of 1,000 frames per minute. 

The two weeks period was cllowed in order to minimize 
any carry-over effect, i.e. the effect cf the retention of 
the reting assigned in the unaided situation. 


Before projecting the sequence of jobs, the loop sicne 





eorey aoe 
rire ieee 
“hg Tita Te suveaes Lavbivited ao Leds ao dened , 
Mabddhed weiany wun webb Lis ~iobaus ak Yo Seulteh te 
a ee rsedsinlsad aie Aady 
| (et attache add actwwm ed avoda Yo Seieeg « tarts 
Mat Mas GIN Sack galves any ine eneter 261 of come lags 
wc? wmtht 462 Able obi 20 able Sedealens jquod aus Ye 
teal anPucd © 34 cule <wude wen wages 4036 te wang sorta 
heed Sala <bitidwt WINES fee 9d Aived 41 oxerde ouedy 
So WalROOLERL. Th Atwge alt Ye ZesdmeN HAs? ebolveG galeer 
O0) aalteees yheeetrise » Su Siw was GOSH Uhivewdd decd oben 
OS0Nis TOG Sewet] 000.1 to bewge 

ental isle de owen nar stcnoy ciple dt 
Ve Mibbastet 28s Ne doette was ve.1 {SOUTH Meye-rress yas 
«Glave deblage acs oJ ba mh sees poldet eas 

TOOLS (eed od yuaal le «Bate 44s MBLITO LONG eewled 











was projected fur e period ebout 3 minutes. The objective 
of this was to give to the raters a chance to form in their 
mind @ concept of severel paces es shown by the loop. 

After the data was gathered, two studies were made: one 
of the consistency of the group , and the other of the accu- 
racy. 

In the study of the consistency, the raw ratings avera- 
ge was taken, and the percentage of ratings that approached 
the raw average within 5, 7.5 and 10 percent wes celicula- 
ted, in each of the two situations, nemely, uneided and 
aided. Then, the differences of percentages in each group 
and between the two situations were tested for signifi- 
eance using Student's t verieble. 

in the study of acouracy, since the true paces are 
unknown, a determination of values to be considered as 
true ones had to be adopted. The following wes done in 
this thesis: 

ae the operator performing the job was paced 
by a metronome. This assured 6 reasonebly 
constant peace, which was further checked 
oy actual frame-counting. 

b. The metronome bests wore taken es indi-g 
cating the right provercvionality emong 
the paces of each individual job. 


e¢. in each job, the pace whose raw ratings 
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average in the four conditions (unaided and 
aided in each of the two groups) agreed most 
Closely was found. The mean of the averages 
in the four conditions wes selected as the 
corrected rating for this pace. ihen, the 
corrected rating for the other paces was 
determined proportionately with the help 

of the metronome beats. 

After the correoted ratings were thus determined, 
the same procedure edopted in the study of consistency 
was used to study accuracy, the difference obviously 
being that the besis for the consistency study wes the 
averages of the raw ratings, while the basis for the 


eccuracy study was the corrected ratings. 
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DATA 

The date for this thesis was obtained from two groups 

of raters: 

Ll. Group aA. This group was composed of about 
100 students of the hlementary Motion and Time Study classes; 
they hed had no experience either in rating or in the use 
of the loop. 

&. Group B&B. This group was composed of ebout 20 
Yaters, some being staff meabers of the Industriel BSnginevring 
depertment and some being students of tue Advanced Motion 
and Time Study classes. This group wes eaperienced in rating 
end had sireedy used the loop to svme extent. However, no 
member of this group had econtinucus recent practice, in 
either rating or the use of the loop. 

The two groups were separated for study in order to 
maintein their homogeneity as rating groups. This seps- 
retion, added to the fact that the number of members of 
the group A is relatively large, permitted us to assume 
safely stetistical normelity to the semples (ratings) vari- 
ations obtained from the latter group. 

bue to the relatively Szieli nwnber of members of the 
group B, the assumption of normelity of the distribution 
of the ratings could not be considered valid. “therefore, 
the reilebility of the significance of the student's test 
made is not nearly as high es thet of the study run on 


the class A ratings. wsowever, tho study was mede to see 
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if the results would indicate considereble differences between 
the two groups. That was not the case. 

Recognition must aiso be accorded to the fect that ex- 
perience of reters varied widely within group Bb, but was 
constant within group A. For this reason, group B was used 
as an eld to establish the correct velues for meesuring eccu- 
racy, and comperisons of performances were made princie 


pelly from ratdngs made by group A. 





— << = 


ea kr Wal oo Ce 
owen eo -medt A o rd awd al a 

34 Gee ot te e/a @ tow eon 
he, en ee ee ee ee 
ee et oF Peri neree pete! © tine be © Gee ol 


—r ee ae ee eee Lae 
ag, ate ee ee ee CD 









= 3° See ‘c¢‘r = ites «4° = =e 


—aesit ae © thtinthe & & 12 oe 66) Lf oe 


—_=_=—_ ae eee ia —  —s wir r - @& 


—— oes?) ee Fle eee SS ‘1i= on wee 
a * a= ™ . =e. > Fae i a= 
= § a t= 4ttewnr i cee Ge 





DAYIRITIONG AND BarLANATION UF TLAMS 
Certain terms sre used in the thesis with a par- 
ticular meening that may be untanililear te the reader. 
To avoid confusion due te this, these te:ms are de- 
fined es follows: 
Peoe 


Page is defined here as the amount of acceleration 





imparted by the operator on the body members in motion 
Guring the performance. 
Normal sace 
LOO% on a scale with 130% representing maximus 
typical performence. 
consisteonoy 
Conaistency expresses the degree to wiieh retings 
assigned to each performaunce by @& group of reters ogres 
with eech other. Jee irocedure. 
Accuracy 
Aecuracy expresses the degree to which the ratings 
esaigned to each purformance agree with the rating taunt 
should be assigned to the performance. Since the exact 
pece is truly unknown, what should be assigned es the 
rating of each performance nas to be determined by some 
means. The way that this determination wes wede in thls 


thesis is explsined in the rrocedure,. 
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heSULTS 

All the results srrived ot in this thesis cre shown 
in Appendix A. 

Those results can be summarized as follows: 

iL. From the point of view of securacy: 

a. the accurecy in rating wes significently ime 
proved, at least in some peces, in all jobs except the one 
cousisting of walking. In this job, the accursecy in rating 
was Significantly poorer with the loop than without it, 

b. In no case, except in the job consisting 
of walking, wes rating significently poorer with the loop 
than without it, 

&. From the viewpoint of consistency: 

a. The jobs consisting of full arm and forearn 
movement were the only ones that in all cases were rated 
Sisnificantly better when using the loop. 

b. The jobs consisting of fingers end trunk 
movements were rated significantiy poorer in the aided 
condition. 

ec. The jobs consisting of walking and wrist 
movement did not show conclusive results. 

In order to show also the manner by which the use of 
the loop improved the accuracy of the raw averages of the 
Glass A group, 6 graph was drawn end inserted in Appendix A 
(Fig. 1). This greph shows thet the use of the loop had a 


considerable effect in bringing the rew averages nesrer to 
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the 45% line, in other words, to the corrected values 
that should have been assigned to the several paces of 
the jobs. The only exeeption is the job consisting of 
weiking whose uneided raw ratings averages were not helped 
by the loop to eany degree, confirming the results already 


stated in the previous paragreph. 
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CUACLUSIVAS 


The conclusions arrived at by the author should be 
considered with the following thoughts kept in mind: 
1. Group 4A had had no experience in either pace- 
rating or the use of the loop. it has been already shown 
that the effectiveness of the lowp increases considerabiy 


after a certain period of training end practice with it,(20) 








40. Tseng, A. 7., “An Lvalustion of the Lffectiveness of 
Retention of the Goncept of a Standerd Lmbodied in a Multie 
image Pece-Rating Loop", Unpublished Master's Thesis, 
vurdue University. - 








Therefore, the results arrived sat in favor cf the Loup 
should be interpreted es having even wreater significance. 
Also, the results against the ivop should be regerded as 
possibly being due to #e cundition that could be eliminated 
or greetly reduced with further training end practice with 
the loop. 

2. it has aiso been shown that the effectiveness 
of retention in an inéividual's mind of the cuncept cof 


stenderd embodied in the loop is considerebdle.(11) The ree 





ii. Tseng, he Te, Ope eit. 





sults arrived et by group b have possibly been infiuenced 
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by this. However, this could not heve been the case with 
the results from Croup A. 

3. Bed@eause of the fects expicined in te Lata 
section of this thesis, the conclusions were drawn based 
meiniy on the study made of the ratings from Group A, 

The conclusions made by the euthor after «a cwuas of 
the results ere; 

i. xcept in the job consisting of walking, the 
loop proved tv be a powerfui means to improve the accuracy 
of pace-rating, even when it did not improve cunsistency. 

&. The loop preved tc be considerebly more valuable 
in improving the consistency of pece-rsting in the cases of 
jobs involving body members identical to those shown in the 
loop, than in all the cases where tiie body members were other 
than those shown in the loop. 

3. The loop seems to be a powerful means to 
esteblish e concept of stsendard emong a group of individuals. 

4. The loop proved to be particulsriy helpful 
in improving the accuracy of the ratings when the pece of 
the job is well above the normal. Unfortunetely, the fast 
pece of the walking job (the only one whose ratings were not 
improved in accuracy) was not well above the normal. It was 
about 115%. Therefore, nothing can be seid for this job in 


the aspect being considered in this paragraph. 
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SUGGESTIONS 


Yrom the comments obtained from the raters who per- 
formed for this thesis and the author's own observations, 


the followlng suggestions ere mede here; 


i. The length of time during which a job filmed 
should be exposed to the raters, in order to provide ade-~ 
quate time for somperieon with the loop, should be inves- 
tigate. The length of time used by the author, about 30 
seconds, wes considered too short by e few raters. 

2. The number of imeges in «© multi-imagse loop 
that can provide edequete spacing between the paces, and, 
eat the same time, permit a quick and easy comparison be- 
tween the loop and the job being studied should be ine 
vestigated. . 

5. The author found out that there is no uni- 
form mental process when reters use the loop. Some raters 
try first to obtain in their minds a good concept of the 
peace of the job being studied, and then they look at the 
loop for comparison. Other raters keep their eyes moving 
from the job to the loop and vice-versa, thus trying to 
make the comparison. it seems to the suthor that the 
first process is more efficlent and even more accurate. 
However, this is just a personal opinion. The matter 


should be investigated. At least, in investigations in- 
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volving, the loop, the procedure should be standardized. 

4. it is possible that jobs involving the same 
pace of the seme body member, but with different displace- 
ment or length of movement, may be rated differently; in 
other words, the tendency may be to count specific novenents 
rather than to rate from an overall impression of scceler- 
ation. This might be a problem that would be interesting 


to investigate. 





a Wo savior we al estat # 


hore Py: 
saris tens AE ras 
cmaseees vy cnieewages Liveens | a rasthiohied tag 
anlinerwaa! 8 Aveow 4043 aadony + 66 ste 16 oan 


ee ry ——e io’ oe ot ——— 

a ae wa ad « ow et Ve come! ao 
ORO +o mnt od emma toe 
ita + < —~ he ee .) 

















Phil x T emis b4 tee bee Gee — wll 
: ee ee ——— et ae Oe Se 


— “i ien—Z~ h wahwee owt ae a Oe fe >. = 


Til 

=59 ome tae <b @§ =e &e 
ee eee ee — so ~~ — as «mds «@ 
er tees oe 6 - i s ' ° « 
ant 40 Gee cell cet! - = Gut . ‘* . . =e 
—h& «© «& = am : _ > — 
a = . — . o oa 
- moe - 
ip —s e 7 
: = - . ; - 





eae adores ate ane wy my 





rept 


Table 1. wispley of the Significant Difference 
in :ercentage vVeviations between the Unuided and the 
Alded Situetions in the Class A Katings, from the View- 
point of Consistency at the 5% Level of Significence. 


Key 
- meens that no signifioent difference was round. 
*mneans that the difference was significant elso at 


_the 1% level of significance. 
A&A means thet the difference was against the use of 


the loop. 
¥ means thet the difference wes in favor cf the use 


of the loop e 
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Teble 2. wisplay of the Significent Lifference in 
sercentage Leviations Between the Unaiéed and the Aided 
Situations in the Class B Ratings, from the Viewpoint of 
Consistency, at the SS Level of Significance. 


means that no Significent difference was found. 
‘means thet the difference was significent also 

et the 1% level of significence. 

means that the difference was egsinst the use of 
the loop. 

F moens that the difference was in favor of the use 
of the loop. 
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Table 3. Display of the Significant Difference in 
Percentage Deviations Between the Unaided and the Aided 
Situations in the Class A Ratings from the Viewpoint of 


Accuracy, at the 5% Level of Significance. 


- means that no sixniflicant difference was found. 

* means thet the difference was significant also at 
the 1% level of significance. 

A means that the difference was egsinst the use of 
the loop, 

F means that the difference was in favor of the use 
of:the loop. 
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Table 4. Lbisplay of the Significant vifference in 
xercentege Deviations Between the Unaided and the Aided 
Situations in the Class B Katings from the Viewpoint of 


Accuracy, at the 5% Level of Significance. 


hey; 


- means thet no Significant difference was found, 

* means that the difference was significant also 
at the 1% level of significance. 

A means thet the difference was against the use of 


the Loop. 
F¥ means that the difference was in favor of the use 


of the loop. 





“low pace Kedium pace ijast pace 


dob i 

Within 5% - . “ 

Within 7.5% ¥* 2 ~ 

Within 10% B* = a 
Job 2 

Within S% F* 7 - 

Within 7.5: - - ad 

Within 10% ~ = ¥* 
Job 3 

Within 5% ¥ “ b 

Within 7.5% - ¥* F* 

Within 10% ~ F* F* 
Job 4 

Within 5% - ~ ¥* 

Within 7.5% F - al 

Within 10% - - - 
dob 5§ 

Within 5% - - - 

Within 7.5% - ~ = 

Within 10% - zs ’ 
Job 6 


within 5% * 
Within 7.5% A 
within 10% - - = 





Table 5. Yercentages of the Class A Ratings within 
Given Fercentage Deviations from the Haw Ratings Averages 


(Consistency) in the Aided end in the Unaided Situetions. 


Film No. 5% 7.5% 10% 

U A DOO U A 
he 27.10011,71  28.97-10592  47.66-20.72 
2. 27.36-27.95 43.59-44,14  57.58-58.56 
3. 24.50-26.15 537.55-40.54  47.66-53.15 
4. 22.43-15.51 22.45-27.03  60.75-42.34 
5. 13.21-45.05 41,.51-54.05  54.72-63.00 
6. 20.75-18.18 44.34-21.82  44.54-37.27 
V. 18.69-24.54 19.63-28.18  53.27-40.00 
8. 41.12-57.27 41.18-62.73  43.93-71.82 
9. £4.30-40.91 65.42-50.00 69.16-59.09 

10. 25.28-32.43 29.91-44.14 29.91-59.46 
ll. 135,08-30.91 31.78-40.00 31.78-49.09 
12. 46.73-29.36 61.68-39.45  63.55-55.05 
13. 29.91726.13 62.62-49.55  64.49-55.86 
14. 14.95-45.95 14.95-62.16  62.62-67.57 
is. 33.64°S6.94 65042-47.75 70.09-50.45 
16. 22.43-27.08 45.79-45.95  50.47-55.56 
17. 21.50-31.53 36.32-41.44  44.86-46.85 
18. 23.86°32.45 43.93-51.35  56.07-61.26 


Key: U; Unaided; <A: Aided Situation. 
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Teble 6. 


and the Aide@ Situations in Table 5. 


Film No. 
Le 
R. 
Se 
4. 
De 
6. 
Te 
8. 
9. 

10. 
ii. 
Lé. 
1S. 
14. 
1S. 
16. 
17. 


iS. 


Sf 
2874 
0.094 
0.51 
1.719 
D186 
0.510 
1.050 
0.584 
£624 
1.176 
3.184 
& 644 
0.477 
4.984 
0.510 
0.788 
1.683 
1.494 


7.5% 
1.758 
O.ii1 
0.480 
0.789 
iL.855 
52960 
i .482 
5.197 
#511 
£i79 
1.267 
5.280 
i.948 
7164 
2.673 
0.011 
0.471 
1.099 


Student's t Values Calculated to Test 
the Difference Between the Values Given for the Unaided 


10% 
4.196 
0.147 
0.811 
2.720 
1.240 
1.065 
1.966 
4.188 
1.552 
7 L035 
2.097 
1.280 
1.506 
0.769 
&.967 
1.200 
0.295 


0.779 
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Table 7. Fercenteges of the Cless B Ratings Within 


Given Ferecentage Deviations from the Rew Ratings Averages 


(Consistency) in the Unaided and the Aided Situations. 


Film No. 5% 7.5% 10% 
U a U A U e 
i. 42.86-11.76 52,38-25.53 61.90-47,.07 
2. 38.10-66.67 &88.10-72.22 66.67-72.22 
De 0S oe SUHhE SE 92 258-95 .596 SO .95=-55 .56 
4. 33 .5S-3535.383 57.14-44.44 71.45-50.00 
De 53-10-50 .00 47.62-77.78 9714-83 .335 
6. 14 29-22 .82 47 .62-35.53 DE S586 .67 
7. 53.53-33.55 33.53-61.11 47.62-76.22 
8. 53.35-50.55 38.10-83.35  66.67=-94.44 
9. 42.86-22.62 61.90-50,.00 66-67-50 .00 
10. 02.56-47,.06 52.38-58.82 61.90-70.59 
il. 25e81-53.353 28.57-72.22 42.86-72.22 
12. 06.1022 .22 58 ,10=22 .22 61.90-66 .67 
13. O3e5S—-22.E2 52.38-35.33 57.1433 .33 
14, 61 .90-36 .89 61.90-66.67  80.95-77.78 
15. 47 .62=-22.22 66.67-33.53 71.43-50.00 
16. 38 .10-27.78 47.62-35.89 47.62-44.44 
17. 14.29-27.78 25.81-27.78 28.57=-44.44 
18. 55.35-27.78 33.53-38.89 57.14-66.67 
Key: Us: Unaided situation; A: Aided situation. 
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Table 8. Student's t Valles Calculated to Test the 
bifference Between the Values Given for the Unaided and the 
Aided Situations in Table 7. 


Film No. 5% 7.5% 10% 
i. 2.145 2.127 0.932 
a. 1.780 2.130 0.574 
3. 1.929 0.202 1.713 
4. 0 0.791 1.382 
S. 0.747 1.929 1.765 
6. 0.644 0.904 0.904 
7. 0 1.734 1.557 
8. 1.089 2.862 2.141 
9. 1.363 0.747 1.055 

10. 0.331 0.526 0.572 
ll. 0.658 2.720 1.944 
12. 1.072 1.072 0.310 
13. 0.768 1.197 1.486 
14. 1.434 0.310 0.244 
15. 1.648 2.077 1.382 
16. 0.662 0.545 0.198 
17. 1.040 0.264 1.030 
18. 0.374 0.362 0.610 
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Tabdie 9. 


Percentages of the Class A Ketings #itain 


Given rercentage Leviations from the Corrected kKatings 


(Accuracy) in the Unaided and the Aided Situations. 


Film No. 


16. 
i?. 
is. 


Key: 


Us 


Si 
U A 
14.95-17.12 
19.91-29.72 
16 82-19 .81 
1.87- 6.51 
6 .60-16.21 
19.6122 .27 
0 .95-15.45 
&eS0-LZ .73 
45..79=-41,32 
38 .5E-56.94 
5.61-17.27 
£21 .49-28 .44 
5.74- 9.90 
47 .66-47.75 
40 .19-36 .04 
4.67-19,82 
£0 .56=-32 .43 
BO oI6-27 .93 


Unalded situation; 


As 


7.5% 

U A 
16 .61-34 .23 
42.45-51.35 
$0.84-31.53 

2 .B0924.32 
6.60=21.62 
37 .835~-36 .36 
3. 7424.54 
11.21-32.73 
47.66-51.82 
58.88~-52.25 

§ 61-24 ,54 
26 .17-37.61 
11 .21-21.62 
51.40-64.86 
65.42-49,55 
43 .92-54.05 
41.18-41.44 
44 .86-50.45 


10% 

U A 
24.50-45 .94 
41.11-59 .46 
56 45-59 .64 

5.61-50.61 
6 .60-21.62 
37 92-45 .45 
15 .06-55.64 
11.21+55 .,.64 
69.16-60.91 
$0.75-65.96 

7 48-40 .00 
26 «17-50 .46 
1508-23 .42 
58 .838-70.27 
69 ..16-56.76 
43 92-54 .95 
44 .86-45,96 
48 .00-60.56 


Aided situstion. 
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Table 10. Student's t Value Calculated to Test 
the Lifference Between the Values Given for the Uneided 
end the Aided Situation in Table 9. 


Film No. 5% 7.5% 10% 
a 0.436 2.966 3.360 
2. 1.684 1.322 1.686 
5. 0.573 0.1210 0.487 
4. 1.662 4.668 4.817 
5. 2.266 3.196 3.196 
6. 0.447 0.225 1.1382 
7. 0.279 0.225 0.360 
8. 2.758 0.385 0.671 
9. 0.694 0.617 1.283 

10. 0.211 0.989 0.491 
1. 0.855 5.945 6.000 
12. 1.192 1.621 4.432 
13. 1.604 2.0382 1.988 
14. 0.013 2.024 1.765 
15. 0.633 2.382 1.898 
16. 3.435 1.502 1.636 
17. 1.994 0.0468 0.164 
18. 0.778 0.630 1.752 
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Tebie ll. 


Percentages of the Class B Katings within 


Given rercentage Devietions from the Corrected Ratings 


(Accuracy) in the Unaided and the Aided Situations. 


Film No. 


16. 
i7. 
1s. 


Key: 


U: Unaided situation; 


Sie 

U fi 
$8 .09-25.595 
19 .09-66.67 
42.86- 5.55 
28.57-11.11 
14 .28-58.89 
42 .86-27.78 
4.76-33 .33 
4.76-38 .69 
42 .85-35 .69 
47 .62-47.05 
14.28-35 255 
47 .62-27.78 
19 .05-22.2% 
61 .90-38.89 
47 .62-16 .67 
9.52-11.11 
14 .28-355 .89 
£3 81-55 .55 


7.5% 

U h 
47 62-25 .55 
5S 0S5—76 28 
52.58- 5.55 
53 09-16 .67 
14.28-55.55 
47.62-35 .53 

4.76-50.00 
14 .28-66.67 
47.61-38 .69 
61.90-58 .82 
14 .,28-44 .44 
Sk 2 d6-GU .89 
38 610-38 .59 
71.42-61.11 
62 .38-53.55 
42 .86-38.89 
19 .05-44 .44 
71.42-66 .67 


LOfe 
U A 
O47 14-55 689 
53 09-72 .22 
7142-16 .67 
4.2 «86-44 .44 
14.28-6] .11 
47 .62-55 .55 
19 .05=72 .22 
23 81-72 .z 
71 .45-61.11 
61.90-70.59 
33 .55=<76 28 
52-58-50 .00 
47.62~44 .44 
80.95-86 .67 
71.46-38 .89 
42 .86-55 .89 
25 .81-55.55 
71.46~-66 .67 


A: Aided situation. 
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Table 12. 


bifference Between the Values Given for the Unaided and 


the Aided Situation in Table 11. 


Film ho. 
Le 
Be 
Se 
4. 
Dd. 
o. 
7° 
Ge 
9. 

lO. 
ii. 
iz. 
13. 
14. 
15. 
16. 
17. 
ig. 


5% 
0.977 
3,011 
2.666 
1.346 
1.759 
0.976 
1.808 
2.144 
0.851 


1.408 
1.«69 
0.244 
1.454 
£044 


1.759 
0.658 


7.5% 
1.557 
2eA2S 
5.159 
1.461 
2.726 
0.904 
2.816 
5.596 
0.548 
0.196 
2.085 
0.042 


Student's t Value Calculated to Test the 





662 f60T oF d6ielvuled auieY ¢ e’eoatude 12h wigeT 
Sne Sabian ad’ ol movie eaves) Sud Mowneud camew Vide) 
lhe US A olsen he bobbe ada 








7 . Sombth 
i mA) Pie ai 
| Bie a 
~ 68... ww BLA oo 
ee es ae 7 
. . ae - — 
* 02.0 | eo 
oo 7% 
«eee. * 
» 6690. oe 
a ee = & +04 
~ eeove. Ooms, th 
| £6650 | - eee t 8k 
= wa@ ona.o ok 
Bet —§ 066.0 | ace. aL 
eee Reed ao0 8 OL 
a on.0 (bOL,9 OL 
ry APL weT.6 ayy 
086.8 eo 85.8 os 


Teble 13. 


Values of the Means of the Raw katings in 


the Unaided end the Aided Situations for Ekach of the Two 


57 


Groups (A ené B) Used as e Basis for the Study of Consistency. 


Filia ic. 


1. 
Re 
Oe 
4. 


Oe 
Te 
&. 
9. 


10. 


Note: 


Gless A 
U n 
88 .79-106 .21 
122.12-125.29 
127 .90-127-97 
95 .06-107-40 
137 .12-153.96 
117.96-108.83 
103 ,.64-125.00 
136.10-151.67 
LOE .59-105.19 
S$ .40- 98.86 
lLéE .66-129 .84 
97.65=- 92.04 
95.70-105.68 
G6.59- 99.79 
94.05- 94.67 
75.735=- 85.87 
85.90- 95.90 
128 44-129 .36 


Class B 
U A 
99.19-l11.12 
119 ..S2-128.61 
120 .02-139.55 
105 ..55-115.94 
154.76-170.83 
106 .G90-105 .28 
114.76-138.67 
142.90-159.11 
104.58-112.44 
G9 .5S- 99.71 
151 .14-149 .67 
91.90=- 88.00 
105 .67-111.78 
97.35-106.1]1 
968.57- 94.17 
85.95=- 90.50 
91.65-105.17 
119 .67-130.39 


The films selected as those where best agresment 
between ratings were found are: 1, 10, 14, 17, 18 and 


15. 
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Table 14. Cwrrected katings Teken es basis for the 


wtudy of Accuracy. 


Film No. Corrected khatings 
i, 101.83 
2. 123.80 
3. 115.94 
4, 111.48 
S$. 117.95 
6. 104.29 
7. 141.86 
8. 170.84 
9. 101.45 

1o. 96 .84 
re 146.55 
12. 90.69 
13. 118.22 
14. 99.04 
is. 95.46 
16. 64.26 
i7. 94.21 
1s. 


126.96 
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babbLANaTiON GF SPATLISTICSN PauChuURh 


the percentages of ratings within given percentage 
deviations from the raw averages and from the corrected 
ratings, found respectively in the studies of consistency 
and eccuracy, were tested for significance by means of the 
Student's t variable. 

This test requires the assumption that the ratings ob- 


teined came from a normally distributed population, \12! 








12. s@wards, A., "experimental design in i sychological 
Research", New York, ’c Graw-Hill Book Go., 1950. 
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This essumption was made as explained in the vata section 
of this thesis. 


The formula used to express Student's t veriable wes: 


where Py is the percentage deviation from the raw ratings 
average, in the consistency study, or from the corrected 

rating, in the accurecy study, in the uneided situation; 

Pe is the sane statistics in the aided situation and ¢e 

is the standard error of the quantity Pi ~ Ps » belng 


given by the formula: 
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where: 





By + Rg 


and Ay and i, are the number of ratings used in each situe- 
ation. The nwaber of degrees of freedom is given by the 


formula: 


& t =. nh) + ne - & 


The test consisted of proposing the hypothesis that 
the percentage deviations found were typical percentage 
deviations drawn from a normal population. The value of t 
wes calculated end compared with the limiting values of 


t given by a table.(25) if the value of t calculated is 





15. 0. &, seters and R. Van Voorhis, "otatistical srocedures 
and Their Xathematical Besis", New York, Ke Graw-iiill Book 
COe, 1940. 





greater than the table value, at the level of significance 
chosen, the hypothesis is not tenable; in other words, 
there is a difference between the two percentages cone 


sidereé which is greater than should be expected of typi- 
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Cal percentage deviations drawn from normal population. 
Two levels of significance were chosen: 1% and 5%. 
Statistically speaking, a statement is made at the n%® 

level of significance when one has only m chances out of 

100 that the statement made is not true, 

The limiting values of t for the numter cf degrees of 


freedom involved in all cases were: 


\ 


At 1l® level of significance: t £208 


At Se level of significance: Ss = Ac¥¥ 


The number cf ratings obtained were as follows: 


Group 4 
Unaided: 107 
Aided: Lil 


Group 5 
Uneided: al 
Aided: L& 
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CAML CALCULATIONS 


Gelculation of mean or average values, example from 


Group B, unaided, fiim no. 1: 


wy retings - 2083 


= — 


tio. Of ratings 21 
Calculations of the percentage of ratings within siven 
percentage deviations from the corrected ratings, example 


from Group A, unsided, film no. 1: 


ut 6% ut7.5% M = 10% 
96.26 to 106.40 93.37 to 108.93 91.20 to 111.46 
200 x16 34.95 100 x18 16.82 200 X26 _ 24.30 

lO7 107 107 


Calculations of Student's t values, example from Group 


A, accuracy, film no. 1, within 5%; 


0 oL7LE ail O 01495 





~ 0.436 


th 


f 0.1603 x 0.8397 ( 1/107 + 1/107 ) 


Significance: not significant at both 1% and 5% levels. 
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Metronome beats and frames per cycle 


Film ne. aetronome ¥rames/cycle 
re 120 9 
z 100 21 
+) 176 i4 
“+ 80 13 
e) 204 10 
6 70 29 
7 168 6 
S 158 15 
g 154 16 

10 70 iS 
di 166 Le 
12 .60 6 
LS 144 7 
14 80 26 
15S 130 19 
18 60 17 
L7 108 L9 
18 84 24 
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